System and Method for Registration Between Coordinate Systems and Navigation of Selected Members

ABSTRACT

Disclosed is a system for assisting in guiding and performing a procedure on a subject. The subject may be any appropriate subject such as inanimate object and/or an animate object. The guide and system may include various manipulable or movable members and may be registered to selected coordinate systems.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application includes subject matter similar to that disclosed inconcurrently filed U.S. patent application Ser. No. ______, (AttorneyDocket No. 5074A-000210-US). The entire disclosure of the aboveapplication is incorporated herein by reference.

FIELD

The subject disclosure is related generally to a tracking and navigationsystem, and particularly to registering coordinate systems for variousprocedures, such as navigating one or more members during a procedure.

BACKGROUND

This section provides background information related to the presentdisclosure which is not necessarily prior art.

An instrument can be navigated relative to a patient for performingvarious procedures. During a surgical procedure, an instrument can betracked in a navigation or tracking space that may also be or include atleast a portion of a patient space. A location of the instrument that istracked can be displayed on a display device relative to an image of thepatient.

The position of the patient can be determined with a tracking system. Totrack the patient relative to the image, however, generally, the patientis registered to the image, via tracking an instrument relative to thepatient to generate a translation map between the subject or objectspace (e.g. patient space) and the image space. This often requires timeduring a surgical procedure for a user, such as a surgeon, to identifyone or more points in the subject space and correlating, often identicalpoints, in the image space.

After registration, the position of the instrument can be appropriatelydisplayed on the display device while tracking the instrument. Theposition of the instrument relative to the subject can be displayed as agraphical representation, sometimes referred to as an icon on thedisplay device.

SUMMARY

This section provides a general summary of the disclosure, and is not acomprehensive disclosure of its full scope or all of its features.

A system that allows for tracking of various members is disclosed. Thesystem may track a plurality of members in a navigation or trackingspace simultaneously. Each of the tracked members may be related tovarious portions, such as portions in an image. The image may besegmented to differentiate and delineate the portion to allow forsubstantially real time (e.g. minimal or no lag between real spacemovement and image representation) of a plurality of members in anavigation space. The navigation system may operate or receive trackinginformation from a plurality of tracking systems, including a firsttracking system operating in a first tracking modality (e.g.electro-magnetic (EM)) and a second operating system operating in asecond tracking modality (e.g. optical tracking).

To illustrate or navigate relative to an image, registration may occurbetween a selected physical space (e.g. subject space or navigationspace) and an image space (e.g. defined by an image). According tovarious embodiments imageable fiducials may be used to performregistration. For example, a fiducial object can be imaged with animaging system and can be identified or segmented in image data andimage. The fiducial object may be connected to a selected system, suchas a robotic system. The robotic system may include an appropriaterobotic system, such as a Mazor X™ Robotic Guidance System, sold byMazor Robotics Ltd. having a place of business in Israel and/orMedtronic, Inc. having a place of business in Minnesota, USA. Thefiducial object may also be connected to a subject and/or positionrelative to a subject during an imaging procedure. Further, naturallyoccurring or inherent features of the subject may be identified asfiducial objects.

The fiducial object may include one or more objects, such as an array ofdiscrete objects. The discrete objects may include spheres, objects ofvarious shapes, a continuous and/or one or more rods that can all be inone or intersect one plane. The fiducial object can be modeled inthree-dimensional (3D) space as a 3D model. Fiducial features can beextracted from the 3D model. The fiducial features can be compared to orcoordinated with image fiducial features that result from the fiducialobject or some portion thereof (e.g. an image fiducial feature can be apoint relating to a center of a sphere or a circle or point relating toan intersection of a rod with a plane) being imaged.

Tracking device may have one or more tracking members that may bepositioned within a navigation space to be tracked with one or moretracking systems. For example, a tracking member may be connected to oneor more members or portions of a subject. A tracking member may beconnected to a vertebrae or portion of a vertebrae of a patient.Similarly, a tracking device may be connected to one or more portions,such as a support beam, of any selected structure such as an automobile,air frame, cabinet system, or the like. Regardless, the tracking memberis generally positioned in a fixed manner relative to a member orportion of the subject so that a relationship may be determined and usedto allow for tracking the member in the navigation space by tracking thetracking member and determining the position of the connected member inthe navigation space. Accordingly, one or more members may be tracked ina navigation space during a selected tracking procedure. Further,instruments may be positioned or moved into the navigation space thatare separate from the subject, such as drills, awl, implant members,fasteners, or the like.

One or more tracking system may be incorporated into or operated with anavigation system that includes one or more instruments that may betracked relative to the subject. The navigation system may include oneor more tracking systems that track various portions, such as thetracking devices that may be associated with one or more members, suchas boney portions, instruments, etc. The tracking system may include alocalizer that is configured to determine the position of the trackingdevice in a navigation system coordinate system. Determination of thenavigation system coordinate system may include those described atvarious references including U.S. Pat. Nos. 8,737,708; 9,737,235;8,503,745; and 8,175,681; all incorporated herein by reference. Inparticular, a localizer may be able to track an object within a volumerelative to the subject. The navigation volume, in which a device, maybe tracked may include or be referred to as the navigation coordinatesystem or navigation space. A determination or correlation between thetwo coordinate systems may allow for or also be referred to as aregistration between two coordinate systems.

Furthermore, images may be acquired of selected portions of a subject.The images may be displayed for viewing by a user, such as a surgeon.The images may have superimposed on a portion of the image a graphicalrepresentation of a tracked portion or member, such as an instrument.Also, various portions of the image may be segmented (e.g. boneymembers). According to various embodiments, the graphical representationmay be superimposed on the image at an appropriate position due toregistration of an image space (also referred to as an image coordinatesystem) to a subject space. A method to register a subject space definedby a subject to an image space may include those disclosed in U.S. Pat.Nos. 8,737,708; 9,737,235; 8,503,745; and 8,175,681; all incorporatedherein by reference.

The graphical representation of a selected instrument, which may beseparate from the subject, may be superimposed on the displayed image.The superimposed graphical representation may illustrate the position ofthe instrument that is tracked relative to the subject due to aregistration of the subject or navigation space to the image space andtracking the instrument in the navigation space. Also, as noted above,tracking devices may be connected to various portions of the subject forreference of tracking members relative thereto and to each other.Segmented portions of the subject may be illustrated superimposed on theimage and/or as portions of the image. Segmented portions of the imageor graphical representations thereof may also be moved due to trackingthe tracking devices that are on the various portions. The image,therefore, may be updated to include a representation of the trackedportion of the members (e.g. bony portions) due to tracking of thetracking devices.

During a selected procedure, the first coordinate system may beregistered to the subject space or subject coordinate system due to aselected procedure, such as imaging of the subject. In variousembodiments the first coordinate system may be registered to the subjectby imaging the subject with a fiducial portion that is fixed relative tothe first member or system, such as the robotic system. Due toregistration of a second coordinate system to the first coordinatesystem may allow for tracking of additional elements not fixed to ortracked in the first coordinate system to a position determined ortracked within the first coordinate system and/or images of the subject.

The tracking of an instrument during a procedure, such as a surgical oroperative procedure, allows for navigation of a procedure. When imagedata is used to define an image space it can be correlated or registeredto a physical space defined by a subject, such as a patient. Accordingto various embodiments, therefore, the patient defines a patient spacein which an instrument can be tracked and navigated. The image spacedefined by the image data can be registered to the patient space definedby the patient. The registration can occur with the use of fiducialsthat can be identified in the image data and in the patient space.

Further areas of applicability will become apparent from the descriptionprovided herein. The description and specific examples in this summaryare intended for purposes of illustration only and are not intended tolimit the scope of the present disclosure.

DRAWINGS

The drawings described herein are for illustrative purposes only ofselected embodiments and not all possible implementations, and are notintended to limit the scope of the present disclosure.

FIG. 1 is diagrammatic view illustrating an overview of a robotic systemand a navigation system, according to various embodiments;

FIG. 2 is a detailed environmental view of a tracking system, accordingto various embodiments;

FIG. 3 is a detailed environmental view of a tracking system, accordingto various embodiments;

FIG. 4 is a display device illustrating a first image;

FIG. 5 is a display illustrating a second image;

FIG. 6 is a flowchart of a method;

FIG. 7 is a detailed environmental view of a tracking system, accordingto various embodiments;

FIG. 8 is an illustration of instruments with tracking devices,according to various embodiments;

FIG. 9 is an illustration of an instruments with a tracking device,according to various embodiments;

FIG. 10 is a detailed environmental view of a tracking system, accordingto various embodiments;

FIG. 11A is a detailed environmental view of a tracking system,according to various embodiments;

FIG. 11B is a display illustrating an image with tracked portionstherein, according to various embodiments;

FIG. 12A is a display illustrating an image with tracked portionstherein in a first relative position, according to various embodiments;and

FIG. 12B is a display illustrating an image with tracked portionstherein in a second relative position, according to various embodiments.

Corresponding reference numerals indicate corresponding parts throughoutthe several views of the drawings.

DETAILED DESCRIPTION

Example embodiments will now be described more fully with reference tothe accompanying drawings.

The subject disclosure is directed to an exemplary embodiment of asurgical procedure on a subject, such as a human patient. It isunderstood, however, that the system and methods described herein aremerely exemplary and not intended to limit the scope of the claimsincluded herein. In various embodiments, it is understood, that thesystems and methods may be incorporated into and/or used on non-animateobjects. The systems may be used to, for example, to register coordinatesystems between two systems for use on manufacturing systems,maintenance systems, and the like. For example, automotive assembly mayuse one or more robotic systems including individual coordinate systemsthat may be registered together for coordinated or consorted actions.Accordingly, the exemplary illustration of a surgical procedure hereinis not intended to limit the scope of the appended claims.

Discussed herein, according various embodiments, are processes andsystems for allowing registration between various coordinate systems. Invarious embodiments, a first coordinate system may be registered to asecond coordinate system. The first coordinate system may be a firsttracking space defined by a first tracking system having a firstlocalizer and the second coordinate system may be a second trackingspace defined by a second tracking system having a second localizer.Either or both of the first and second coordinate systems may beregistered to additional coordinate systems or spaces (e.g. thirdcoordinate system, fourth coordinate system, etc.). The additionalcoordinate systems may include an image coordinate system or spaceand/or subject coordinate system or space. As discussed herein, anavigation space or coordinate system may be defined relative to thesubject space and by, at least in part, a tracking system space.

With initial reference to FIG. 1, a procedure theater, such as asurgical operating room, is illustrated. Positioned within the surgicaltheater may be various systems and members to be used during and/orassist in performing a procedure relative to the subject. For example, anavigation system 20 may be positioned within the operating theater.Within the operating theater, the navigation system 20 may includevarious elements or portions, such as an optical localizer 88 and anelectromagnetic (EM) localizer 94, which define or are used to generatenavigation or tracking spaces in selected first and/or second coordinatesystems, as discussed further herein. The respective localizers 88, 94may also be registered, also referred to as correlated, relative to oneanother, as also discussed further herein, to allow for tracking one ormore instruments in either or both of the coordinate systems andrelating the tracked position to an additional coordinate system.Accordingly, the user 72 may track one or more instruments, such as aninstrument 68 relative to a subject 30 and/or track plurality ofportions or members of the subject 30.

The navigation system 20 can be used to track the location of one ormore tracking devices, tracking devices may include a subject trackingdevice 58, an imaging system tracking device 62, and/or a tool trackingdevice 66. The tool 68 may be any appropriate tool such as a drill,forceps, or other tool operated by the user 72. The tool 68 may alsoinclude an implant, such as a spinal implant or orthopedic implant. Itshould further be noted that the navigation system 20 may be used tonavigate any type of instrument, implant, or delivery system, including:guide wires, arthroscopic systems, orthopedic implants, spinal implants,deep brain stimulation (DBS) probes, etc. Moreover, the instruments maybe used to navigate or map any region of the body. The navigation system20 and the various instruments may be used in any appropriate procedure,such as one that is generally minimally invasive or an open procedure.

An imaging device 80 may be used to acquire pre-, intra-, orpost-operative or real-time image data of a subject, such as the subject30. It will be understood, however, that any appropriate subject can beimaged and any appropriate procedure may be performed relative to thesubject. In the example shown, the imaging device 80 comprises an O-Arm®imaging device sold by Medtronic Navigation, Inc. having a place ofbusiness in Louisville, Colo., USA. The imaging device 80 may have agenerally annular gantry housing 82 in which an image capturing portionis moveably placed. The imaging device 80 may acquire image data withx-rays. The image capturing portion may include an x-ray source oremission portion and an x-ray receiving or image receiving portionlocated generally or as practically possible 180 degrees from each otherand mounted on a rotor relative to a track or rail. The image capturingportion can be operable to rotate 360 degrees during image acquisition.The image capturing portion may rotate around a central point or axis,allowing image data of the subject 80 to be acquired from multipledirections or in multiple planes. The imaging device 80 can includethose disclosed in U.S. Pat. Nos. 7,188,998; 7,108,421; 7,106,825;7,001,045; and 6,940,941; all of which are incorporated herein byreference, or any appropriate portions thereof. In one example, theimaging device 80 can utilize flat plate technology having a 1,720 by1,024 pixel viewing area.

The position of the imaging device 80, and/or portions therein such asthe image capturing portion, can be precisely known relative to anyother portion of the imaging device 80. The imaging device 80, accordingto various embodiments, can know and recall precise coordinates relativeto a fixed or selected coordinate system. This can allow the imagingsystem 80 to know its position relative to the patient 30 or otherreferences. In addition, as discussed herein, the precise knowledge ofthe position of the image capturing portion can be used in conjunctionwith a tracking system to determine the position of the image capturingportion and the image data relative to the tracked subject, such as thepatient 30.

The imaging device 80 can also be tracked with the tracking device 62.The image data defining an image space acquired of the patient 30 can,according to various embodiments, be inherently or automaticallyregistered relative to an object space. The object space can be thespace defined by the patient 30 in the navigation system 20. Theautomatic registration can be achieved by including the tracking device62 on the imaging device 80 and/or the determinable precise location ofthe image capturing portion. According to various embodiments, asdiscussed herein, imageable portions, virtual fiducial points and otherfeatures can also be used to allow for registration, automatic orotherwise. It will be understood, however, that image data can beacquired of any subject which will define subject space. Patient spaceis an exemplary subject space. Registration allows for a translationbetween patient space and image space.

The patient 80 can also be tracked as the patient moves with a patienttracking device (also referred to as a dynamic reference frame (DRF)) ortracker 58. Alternatively, or in addition thereto, the patient 30 may befixed within navigation space defined by the navigation system 20 toallow for registration. As discussed further herein, registration of theimage space to the patient space or subject space allows for navigationof the instrument 68 with the image data. When navigating the instrument68, a position of the instrument 68 can be illustrated relative to imagedata acquired of the patient 30 on a display device 84. Various trackingsystems, such as one including the optical localizer 88 or theelectromagnetic (EM) localizer 92 can be used to track the instrument68.

More than one tracking system can be used to track the instrument 68 inthe navigation system 20. According to various embodiments, these caninclude an electromagnetic tracking (EM) system having the EM localizer94 and/or an optical tracking system having the optical localizer 88.Either or both of the tracking systems can be used to tracked selectedtracking devices, as discussed herein. It will be understood, unlessdiscussed otherwise, that a tracking device can be a portion trackablewith a selected tracking system. A tracking device need not refer to theentire member or structure to which the tracking device is affixed orassociated. It is further understood that additional or alternativetracking systems may also be used, such as radar, acoustic, ultrasonic,and/or other tracking systems. Generally, the tracking system tracks thetracking device in the tracking or navigation space. The tracking systemis able to generate a signed based on the tracking (e.g. within a fieldof view of a camera, EM field, etc.) and the signal is used within thenavigation system to determine the position of the tracked element. Invarious embodiments, the determined position may then be illustrated ona display device relative to another coordinate system, such as imagespace.

It is further appreciated that the imaging device 80 may be an imagingdevice other than the O-Arm® imaging device and may include in additionor alternatively a fluoroscopic C-arm. Other exemplary imaging devicesmay include fluoroscopes such as bi-plane fluoroscopic systems, ceilingmounted fluoroscopic systems, cath-lab fluoroscopic systems, fixed C-armfluoroscopic systems, isocentric C-arm fluoroscopic systems, 3Dfluoroscopic systems, etc. Other appropriate imaging devices can alsoinclude MRI, CT, ultrasound, etc.

In various embodiments, an imaging device controller 96 may control theimaging device 80 and can receive the image data generated at the imagecapturing portion and store the images for later use. The controller 96,in various embodiments, may include a processor 97 and/or various memoryportions. The controller 96 can also control the rotation of the imagecapturing portion of the imaging device 80. It will be understood thatthe controller 96 need not be integral with the gantry housing 82, butmay be separate therefrom. For example, the controller may be a portionsof the navigation system 20 that may include a processing and/or controlsystem 98 including a processing unit or processing portion 102. Thecontroller 96, however, may be integral with the gantry 82 and mayinclude the second and separate processor 97, such as that in a portablecomputer.

The patient 30 can be fixed onto an operating table 104. According toone example, the table 104 can be an Axis Jackson® operating table soldby OSI, a subsidiary of Mizuho Ikakogyo Co., Ltd., having a place ofbusiness in Tokyo, Japan or Mizuho Orthopedic Systems, Inc. having aplace of business in California, USA. Patient positioning devices can beused with the table, and include a Mayfield® clamp or those set forth incommonly assigned U.S. patent application Ser. No. 10/405,068 entitled“An Integrated Electromagnetic Navigation And Patient PositioningDevice”, filed Apr. 1, 2003 which is hereby incorporated by reference.

The position of the patient 30 relative to the imaging device 80 can bedetermined by the navigation system 20. The tracking device 62 can beused to track and locate at least a portion of the imaging device 80,for example the gantry or housing 82. The patient 30 can be tracked withthe dynamic reference frame 58, as discussed further herein.Accordingly, the position of the patient 30 relative to the imagingdevice 80 can be determined. Further, the location of the imagingportion can be determined relative to the housing 82 due to its preciseposition on the rail within the housing 82, substantially inflexiblerotor, etc. The imaging device 80 can include an accuracy of within 10microns, for example, if the imaging device 80 is an O-Arm® imagingdevice sold by Medtronic Navigation, Inc. having a place of business inLouisville, Colo. Precise positioning of the imaging portion is furtherdescribed in U.S. Pat. Nos. 7,188,998; 7,108,421; 7,106,825; 7,001,045;and 6,940,941; all of which are incorporated herein by reference,

According to various embodiments, the imaging device 80 can generateand/or emit x-rays from the x-ray source that propagate through thepatient 30 and are received by the x-ray imaging receiving portion. Theimage capturing portion generates image data representing theintensities of the received x-rays. Typically, the image capturingportion can include an image intensifier that first converts the x-raysto visible light and a camera (e.g. a charge couple device) thatconverts the visible light into digital image data. The image capturingportion may also be a digital device that converts x-rays directly todigital image data for forming images, thus potentially avoidingdistortion introduced by first converting to visible light.

Two dimensional and/or three dimensional fluoroscopic image data thatmay be taken by the imaging device 80 can be captured and stored in theimaging device controller 96. Multiple image data taken by the imagingdevice 80 may also be captured and assembled to provide a larger view orimage of a whole region of a patient 30, as opposed to being directed toonly a portion of a region of the patient 30. For example, multipleimage data of the patient's 30 spine may be appended together to providea full view or complete set of image data of the spine.

The image data can then be forwarded from the image device controller 96to the navigation computer and/or processor system 102 that can be apart of a controller or work station 98 having a display 84 and a userinterface 106. It will also be understood that the image data is notnecessarily first retained in the controller 96, but may also bedirectly transmitted to the work station 98. The work station 98 canprovide facilities for displaying the image data as an image 108 on thedisplay 84, saving, digitally manipulating, or printing a hard copyimage of the received image data. The user interface 106, which may be akeyboard, mouse, touch pen, touch screen or other suitable device,allows the user 72 to provide inputs to control the imaging device 80,via the image device controller 96, or adjust the display settings ofthe display 84. The work station 98 may also direct the image devicecontroller 96 to adjust the image capturing portion of the imagingdevice 80 to obtain various two-dimensional images along differentplanes in order to generate representative two-dimensional andthree-dimensional image data.

With continuing reference to FIG. 1, the navigation system 20 canfurther include the tracking system which may be one or both of theelectromagnetic (EM) localizer 94 and/or the optical localizer 88. Asnoted above, however, more or alternative tracking systems may also beprovided or used. The tracking systems may include a controller andinterface portion 110. The controller 110 can be connected to theprocessor portion 102, which can include a processor included within acomputer. The controller 110 may also be connected to one or more of thelocalizers, such as the EM localizer 94 and/or the optical localizer 88.The connections may be wired or wireless and allow for single or two-waycommunication. The EM tracking system may include the STEALTHSTATION®AXIEM™ Navigation System, sold by Medtronic Navigation, Inc. having aplace of business in Louisville, Colo.; or can be the EM tracking systemdescribed in U.S. Pat. No. 7,751,865, issued Jul. 6, 2010, and entitled“METHOD AND APPARATUS FOR SURGICAL NAVIGATION”; U.S. Pat. No. 5,913,820,entitled “Position Location System,” issued Jun. 22, 1999; and U.S. Pat.No. 5,592,939, entitled “Method and System for Navigating a CatheterProbe,” issued Jan. 14, 1997; all of which are herein incorporated byreference. It will be understood that the navigation system 26 may alsobe or include any appropriate tracking system, including aSTEALTHSTATION® TREON® or S7 ™ tracking systems having an opticallocalizer, that may be used as the optical localizer 88, and sold byMedtronic Navigation, Inc. of Louisville, Colo. Other tracking systemsinclude an acoustic, radiation, radar, etc. The tracking systems can beused according to generally known or described techniques in the aboveincorporated references. Details will not be included herein except whento clarify selected operation of the subject disclosure.

Wired or physical connections can interconnect the tracking systems,imaging device 80, etc. Alternatively, various portions, such as theinstrument 68 may employ a wireless communications channel, such as thatdisclosed in U.S. Pat. No. 6,474,341, entitled “Surgical CommunicationPower System,” issued Nov. 5, 2002, herein incorporated by reference, asopposed to being coupled directly to the controller 110. Also, thetracking devices 62, 66, 54 can generate a field and/or signal that issensed by the localizer(s) 88, 94.

Various portions of the navigation system 20, such as the instrument 68,and others as will be described in detail below, can be equipped with atleast one, and generally multiple, of the tracking devices 66. Theinstrument can also include more than one type or modality of trackingdevice 66, such as an EM tracking device 66 e and/or an optical trackingdevice 66 o. The instrument 68 can include a graspable or manipulableportion at a proximal end and the tracking devices may be fixed near themanipulable portion of the instrument 68.

Additional representative or alternative localization and trackingsystem is set forth in U.S. Pat. No. 5,983,126, entitled “CatheterLocation System and Method,” issued Nov. 9, 1999, which is herebyincorporated by reference. The navigation system 20, therefore, may be ahybrid system that includes components from various tracking systems.

According to various embodiments, the navigation system 26 can be usedto track the instrument 68 relative to the patient 30. The instrument 68can be tracked with the tracking system, as discussed above. Image dataof the patient 30, or an appropriate subject, can be used to assist theuser 72 in guiding the instrument 68. The image data, however, isregistered to the patient 30. The image data defines an image space thatis registered to the patient space defined by the patient 30. Theregistration can be performed as discussed herein, automatically,manually, or combinations thereof.

Generally, registration allows a translation map to be generated of thephysical location of the instrument 68 relative to the image space ofthe image data. The translation map allows the tracked position of theinstrument 68 to be displayed on the display device 84 relative to theimage data 108. A graphical representation 68 i, also referred to as anicon, can be used to illustrate the location of the instrument 68relative to the image data 108.

As discussed above, the imaging system 80, or any appropriate imagingsystem, may acquire images of the subject 30. The images may beautomatically registered, according to various procedures such as thoseknown in the art, including tracking the imaging system 80 (e.g. withthe image tracking device 62) and tracking the subject 30 with thesubject tracker 58. Other registration processes may include identifyingfiducial or correlation points in the image 108 and on the patient orsubject 30. Fiducial points may include artificial fiducials that areimageable portions (e.g. radiopaque markers) that are positioned onand/or implanted in the subject 30 during acquisition of images with theimaging device 80 and appear on the image 108, such as a fiducial mark113. The user 72 may identify the fiducial mark 113 in the image 108 andthen also identify the fiducial on the subject 30, such as touching thefiducial in the subject with the instrument 68 that is tracked with oneor more of the tracking systems. The navigation system 20 may thendetermine the position of the tracked instrument 68 and correlated itwith the fiducial 113 identified in the image 108.

In various embodiments, when the fiducial portions 113 are imaged withthe imaging device 80, image data is generated that includes oridentifies the fiducial portions 113. The fiducial portions 113 can beidentified in image data as imaged fiducial portions 113 i automatically(e.g. with a processor executing a program), manually (e.g. by selectionan identification by the user 72), or combinations thereof (e.g. byselection an identification by the user 72 of a seed point andsegmentation by a processor executing a program). Methods of automaticimageable portion identification include those disclosed in U.S. Pat.No. 8,150,494 issued on Apr. 3, 2012, incorporated herein by reference.Manual identification can include selecting an element (e.g. pixel) orregion in the image data wherein the imageable portion has been imaged.Regardless, the fiducial portions 120 identified in the image data canbe used as fiducial points or positions that can be used to register theimage data or the image space of the image data with patient space.

In various embodiments, to register an image space or coordinate systemto another space or coordinate system, such as a navigation space, thefiducial portions 120 that are identified in the image 108 may then beidentified in the subject space defined by the subject 30, in anappropriate manner. For example, the user 72 may move the instrument 68relative to the subject 30 to touch the fiducial portions 120, if thefiducial portions are attached to the subject 30 in the same positionduring the acquisition of the image data to generate the image 108. Itis understood that the fiducial portions 120, as discussed above invarious embodiments, may be attached to the subject 30 and/or mayinclude anatomical portions of the subject 30.

Additionally, a tracking device may be incorporated into the fiducialportions 113 and they may be maintained with the subject 30 after theimage is acquired. In this case, the registration or the identificationof the fiducial portions 120 in a subject space may be made.Nevertheless, according to various embodiments, the user 72 may move theinstrument 68 to touch the fiducial portions 113. The tracking system,such as with the optical localizer 88, may track the position of theinstrument 68 due to the tracking device 66 attached thereto. Thisallows the user 72 to identify in the navigation space the locations ofthe fiducial portions 120 that are identified in the image 108. Afteridentifying the positions of the fiducial portions 120 in the navigationspace, which may include a subject space, the translation map may bemade between the subject space defined by the subject 30 in a navigationspace and the image space defined by the image 108. Accordingly,identical or known locations allow for registration as discussed furtherherein.

During registration, a translation map is determined between the imagedata coordinate system of the image data such as the image 108 and thepatient space defined by the patient 30. Once the registration occurs,the instrument 68 can be tracked with the tracking system that isregistered to the image data to allow an identification and illustrationof a position of the tracked instrument 68 as an icon superimposed onthe image data. Registration of the image 108 (or any selected imagedata) to the subject 30 may occur at any appropriate time.

After the registration of the image space to the patient space, theinstrument 68 can be tracked relative to the image 108. As illustratedin FIG. 1, the icon 68 i representing a position (which may include a 6degree of freedom position (including 3D location and orientation)) ofthe instrument 68 can be displayed relative to the image 108 on thedisplay 84. Due to the registration of the image space to the patientspace, the position of the icon 68 i relative to the image 108 cansubstantially identify or mimic the location of the instrument 68relative to the patient 30 in the patient space. As discussed above,this can allow a navigated procedure to occur.

With continuing reference to FIG. 1 and FIG. 2, the patient tracker orsubject tracker 58 may also include more than one tracking element orportion and/or be operable with one or more tracking systems. Forexample, the patient tracker 58 may include one or more opticaltrackable members or portions, such as a reflective member 580. It isunderstood that the optically trackable member may also be an activeemitter (e.g. LED) or passive, such as a reflector. Further, the subjecttracker 58 may include an electromagnetic tracking member or portion 58e. The EM tracker 58 e may be fixed relative to the optical tracker 58 osuch that the position (including three-dimensional location and/or oneor more degree of freedom orientation) is fixed. Accordingly, thepatient tracker 58 may be used as a registration or dynamic referenceframe relative to the patient 30 using at least two tracking systems,such as the optical localizer 88 and the EM localizer 94.

The subject tracker 58 may also be used for registration and/orcalibration of instruments including the instrument 68 with selectedfiducial or registration portion 150. The registration portion 150 mayinclude a divot or indent that the instrument 68 may contact to allowthe navigation system 20 to determine a distal end or terminal end ofthe instrument 68 relative to the tracking device 66. As discussedabove, the tracking device 66 may also be tracked in more than onetracking system including the optical tracking device 66 o and the EMtracking device 66 e.

It is understood that the multiple portions of the tracking device 66may be fixed together in a single unit, similar to the trackable memberor assembly 154. Alternatively, or in addition thereto, the two trackingdevices, such as the optical tracking device 66 o and the EM trackingdevice 66 e, may be fixed relative to one another on the instrument 68.Accordingly, regardless of the configuration, the position of the EMtracking device 66 e relative to the optical tracking device 66 o isfixed for a selected procedure, such as a procedure on the subject 30.

In addition to the subject tracker 58, additional tracking elements mayalso be affixed to the patient 30 including individual or separatemember trackers 160, including a selected number for example, 3,including 160 i, 160 ii, and 160 iii. Each of the individual trackers160 may also be referred to as tracking devices and may be fixed todifferent bony portions that may be movable relative to one another,such as different vertebrae including a first vertebra 166 i, secondvertebra 166 ii, and a third vertebra 166 iii. Accordingly, eachvertebra of the vertebrae 166 may move relative to one another, such asthe first vertebra 166 i and the second vertebra 166 ii. The individualtrackers 160 connected to the individual vertebra may allow for trackingof the individual vertebra relative to one another, as discussed furtherherein.

With additional reference to FIG. 3 and FIG. 4, the patient tracker 58may be fixed relative to the subject 30, such as to a portion of thepelvis, including the iliac crest, or other appropriate portions.Further, the subject 30 may be fixed relative to the table 104 and thepatient tracker 58 also fixed to the table 104, such that there is notmovement between the patient 30 and the patient tracker 58. Regardless,the patient tracker 58 may be used to maintain registration of thesubject 30 relative to the image 108 by measuring and tracking movementof the subject 30 to update a translation that between the subject 30defining the subject space and the patient tracker 58 in the navigationspace relative to the image space.

The patient tracker 58, as discussed above, may include the EM tracker58 e. The EM tracker 58 e may communicate with the navigation system 20,such as through the controller 110, in an appropriate manner such as awireless, wired, or combination thereof. Similarly, or in additionthereto, the member trackers 160, such as the tracker 160 i may alsocommunicate with the navigation system 20 via a wired communication,wireless communication, or combination thereof. As illustrated in FIG. 2and FIG. 3, the vertebrae, including the first vertebra 166 i and thesecond vertebra 166 ii may each include or have connected thereto arespective tracker or tracking device 160 i, 160 ii, respectively.Accordingly, each of the tracking devices 160 may track a selectedmember or element, such as the bony portion including the vertebrae 166.

As discussed above, the tracking system may track the bony portions orthe tracking devices connected to the bony portions in real time. Theimage 108 may include image data or images of the vertebrae, such as thefirst vertebra 166 i′ and the second vertebra 166 ii′. The vertebrae,include each vertebra, may be segmented in the image in any appropriatemanner, such as in a substantially automatic process, manual process, ora combination of manual and automatic processes. The segmentation of thevertebrae may include segmentation such as that used by the Mazor X®Robotic system to segment vertebrae or other appropriate segmentationtechniques. A manual segmentation may include the user 72 outlining ordefining the portions of the image relating to selected portions, suchas the first vertebra 166 i and the second vertebra 166 ii. An automaticsegmentation may include a processor, such as the processor 102,executing an algorithm to segment the vertebrae in the image. Asemi-manual segmentation may include the user 72 identifying a seedpixel or voxel or multiple seed pixels or voxels and the processor mayexecute instructions to segment image data that are related to theidentified seed portions. Nevertheless, the image 108 may includesegmented portions, such as segmentation of the first, second, and thirdvertebrae 166.

In addition to segmentation of the vertebrae, various portions thereofmay be identified. In various embodiments, superior and inferiorendplates of the vertebrae may be segmented or identified in the image108, such as end plates including a first end plate 170 i of the firstvertebrae and a second end plate 170 ii of the second vertebrae 166 ii.It is understood that each of the vertebrae generally include the twoend plates and the discussion of the first and second end plate 170, 174herein is merely exemplary. Further, other portions of the vertebrae maybe identified and/or portions or multiple portions of the endplates maybe identified. The end plates may be automatically identified (e.g.based on the segmentation and angles determined therein) or may be basedon end plate determinations by the user (e.g. identifying ends of theend plates).

Identification of the end plates 170, 174 may assist in identificationof end points or termination portions of the vertebrae 166 in the image108. Further, planes 178, 182 of the respective first end plate 170 andthe second end plate 174 may be identified. Determination oridentification of the planes 178, 182 may be used to measure respectivedistances between the planes 178, 182, such as an anterior distance 184and a posterior distance 188. The difference in distances 184, 188 mayalso be used to define or determine an angle 192 between the planes 178,182. It is further understood that the determination of the angle 192may be made directly between the plains 178, 182. The planes 178, 182may also be defined within the boundary of the segmented vertebraerather than extending therefrom, as illustrated in FIG. 4.

As discussed above the individual or separate tracking devices 160 maybe connected to the separate vertebrae 166. Thus, movement of onevertebra, such as the first vertebra 166 i relative to the secondvertebra 166 ii may be tracked using the respective tracking devices 160i and 160 ii. The tracked changes may then be illustrated on the displaydevice 84 by altering the image 108, as discussed herein, based upon thetracked positions of the tracking devices 160.

With reference to FIG. 5, the vertebrae, for example the second vertebra166 ii may be moved relative to the first vertebra 166 i for variouspurposes, such as attempting to achieve alignment, measuring mobility ofthe vertebrae, or the like. Accordingly, the display 84 may display theimage 108 to illustrate movement of the second vertebra 166 ii as theimage portion 166 ii′. The end plates 170, 174 and respective planes178, 182, having been previously identified, may be illustrated and/ormeasured relative to each other on the display 84. In variousembodiments, the user 72 may provide an input, such as enter a command,with the navigation system 20 to determine a measurement after movementof the second vertebrae 166 ii. Substantially automatically during aprocedure, as well, determination of measurements may be made and/ordisplayed. The navigation system 20, or appropriate system, may measurethe distance or angle, such as a second angle 210 between the planes178, 182. Thus, the user 72 may determine or understand the movement orposition between the two vertebrae 166 i and 166 ii.

Further, after acquisition of the image data and illustrating the image108 in positioning the tracking devices 160 in the respective vertebrae166, the user 72 may also view the position of the vertebrae relative toone another and perform manual manipulation of the vertebrae 166. Asdiscussed further herein, the user 72 may view movement of the vertebrae166 on the display device 84 without requiring acquisition of additionalimage data of the subject 30. In various embodiments, therefore,radiation of the subject 30 and/or user 72, or other users relative tothe subject 30, may be reduced as the image 108 may be altered basedupon the tracked position of the individual vertebrae 166 due to therespective tracking device 160. It is understood, in addition to thevertebrae, other appropriate members and/or instruments may beseparately tracked and their positions may be displayed with the displaydevice 84.

Further, as noted above, the subject 30 may be registered to the image108 in an appropriate manner. Once the subject 30 is registered to theimage 108, the subject tracking device 58 may be used to maintain theregistration. As discussed above, the subject tracking device 58 mayinclude the EM tracking device and the optical tracking portions 580.Accordingly, the optical localizer 88 and the EM localizer 94 may trackthe patient tracker 58. Further, as both the EM tracking device 58 andthe optical tracking portions 58 o are fixed relative to the patient 58at a single location, such as via a connection or clamp 214, both of thelocalizers 88, 94 of the respective tracking system may include a singleorigin or relative reference frame for tracking additional elements orportions relative thereto. Accordingly, the instrument 68, as discussedabove, may include one or both tracking devices 66 e and 66 o to betracked relative to the subject 30 and have a representation 68 iillustrated relative to the image 108.

As each of the tracking devices 160, and others as discussed herein, maybe connected to the subject, they may also be used to maintain and/orconfirm registration. The tracking devices 160 may include a singletracking modality (e.g. optical or EM) while the patient tracker 58 mayinclude multiple tracking modalities (e.g. both optical and EM) to allowfor correlation between the two tracking modalities.

It is understood, however, that other tracking devices, such as thesubject member tracking device 160 may include only a single trackingmodality or type of tracker, such as an EM tracker. According to variousembodiments, therefore, the individual member trackers 160 may onlyinclude a single type of tracking device. In various embodiments, the EMtracking devices may include one or more members of conductive materialformed into coils that may sense and/or emit and electromagnetic field.The coils may be a selected size and configuration to allow forefficient positioning relative to the selected subject members. It isunderstood, however, that the individual tracking members 160 may alsobe formed or provided as other appropriate members, as discussed furtherherein.

Movement of the vertebrae 166, such as the second vertebra 166 iirelative to the first vertebra 166 i may be made by any appropriatemechanism. The movement may be, however, illustrated on the display 84,as illustrated in FIG. 4 and FIG. 5, once identification of respectivetracking devices relative to the respective vertebrae is made. Forexample, the user 72 may use the input 106 to identify the firstvertebra 166 i and the tracking device 160 i associated therewith.Similarly the user 72 may associate the image 166 ii′ with the vertebra166 ii and further associate the second tracking device 160 ii with thevertebra 166 ii. The user 72, or any appropriate person, may identifythe respective tracking devices with the respective vertebra (or anyappropriate individual or separate member). Thus, the tracking systemand/or tracking systems 88, 94 may track the respective tracking devicesindividually. The signals from the respective individual trackingdevices 160 may then be used to identify the particular portions ormembers being moved or tracked as moving. The identified specificmembers are then related to graphical portions of the image, to allowthe image 108 to be updated to illustrate movement of the respectivemember or portions of the subject 30.

The individual tracking devices may also be assigned to the selectedmembers substantially automatically. For example, the patient tracker 58may be known to be at a selected position, such as on the pelvis. Thepelvis may be determined in the image (e.g. by selection orsegmentation). The other members, such as the individual vertebra, maybe segmented in the image 108. The navigation system may be determinedor be instructed with an input that the three vertebra closes to thepelvis have a tracking device connected thereto. The navigation systemmay, then, determine the vertebra in sequence based on the segmentationand assign to each the tracked tracking devices, in sequence of distancefrom the patient tracker 58 on the pelvis.

The tracked motion can be substantially in real time, such as a delay ofless than one second, including a delay of less than 10 millisecondsbetween movement of the member portions (e.g. vertebrae 166) andillustration of movement on the display 84 by changing of the image 108.Thus, the user 72 may view the image 108 with the display device 84 tounderstand substantial real time position and/or movement of therespective members of the subject 30.

With continuing reference to FIG. 4 and FIG. 5 according to variousembodiments, therefore, a procedure relative to the subject 30 may beperformed with the navigation system 20. With additional reference toFIG. 6, a method 260 of performing a procedure, according to variousembodiments, relative to the subject 30 is illustrated. The method 260is generally understood to include features or portions that may beexecuted with input from the user 72, or other appropriate users.Accordingly, according to various embodiments, the subject 30 may bepositioned relative to the imaging system 80 at an appropriate time inblock 264. It is understood that the subject 30 may be positionedrelative to any appropriate imaging system and the imaging system 80 ismerely exemplary. Further the individual member tracking devices orsegmental member tracking devices 160 may be connected to appropriatemembers, such as individual vertebra 166 in block 268. These varioussteps may occur at any appropriate time, but allow for the method 260 tooccur or be performed, as discussed further herein.

The method 260 may include acquisition of image data in block 278. Theacquisition of the image data in block 278 may include scanning thesubject 30 with the imaging device 80, substantially at a selected time,or any other appropriate imaging device. Further the acquisition ofimage data in block 278 may be the recall or accessing of image dataacquired at an appropriate time, such as prior to positioning thesubject 30 in the operating theater relative to the navigation system20. In various embodiments, therefore, image data may be acquired of thesubject 30.

The image data may then be segmented in block 282. Segmentation of theimage data may be segmented in any appropriate manner, as discussedabove. The segmentation may include segmenting the individual vertebrae166 in the image, such as the first vertebra image 166 i′ and the secondvertebra image 166 ii′. Various segmentation techniques, including thosediscussed above, may be used to segment the vertebra. Further, ifspecific or detailed edge extraction or segmentation may not berequired, the user 72 and/or the processor system 102 may identifyvarious endpoints, such as endpoints of the end plates 170, 174.Accordingly, for example, as illustrated in FIG. 4, the user 72 mayidentify two end points 170 i and 170 ii on the first vertebrae image166 i′ and two separate end points 174 i and 174 ii relative to thesecond vertebrae image 166 ii′. The two points may be used to identifythe respective end plates 170, 174 and/or planes 178, 182 and performvarious functions and analysis relative thereto. It is understood,however, that the segmentation may be used to automatically determineendplates and/or planes based upon the geometry of the segmentedportion, relative portions, etc. Accordingly, segmentation of the imagedata in block 282 may include segmenting all edges or boundaries ofrespective portions and/or identifying appropriate or selected portions,such as identifying endpoints and determining lines or planes relativethereto.

Registration of the image data to at least a first coordinate systemoccurs in block 286. Registration to the image data may be to theacquired image data from block 278 and/or the segmented image data inblock 282. Regardless, registration may be made to a first coordinatesystem, such as the coordinate system of the optical localizer 88.Therefore, the image data may be registered in the first coordinatesystem which may be defined by the optical localizer 88. It isunderstood that the first coordinate system may be any appropriatecoordinate system, and reference to optical localizer 88 is merely forexample.

Nevertheless, once registration to the image data is performed in block286 a correlation between the first coordinate system and a secondcoordinate system may occur in block 290. For example, as discussedabove, the EM localizer 94 may also be used to define a navigation ortracking space relative to the subject 30. Correlation between the firstcoordinate system of the optical localizer 88 and the second coordinatesystem of the EM localizer 94 may be performed due to the patienttracker 58 including both the EM tracking device 58 e and the opticaltracking device portion 580. As discussed above, the patient tracker 58holds both of the EM tracking device 58 e and the optical trackingdevice 58 o relative to a single fixed point, also referred to as areference point. Accordingly, registration of either one of theportions, such as the optical tracking portion 58 o to the image datamay be then used to correlate the single point to the second coordinatesystem of the EM tracking system due to the EM tracking device 58 efixed relative to the same point. It is understood, therefore, thatadditional tracking devices may also be associated with the patienttracker 58. For example, a radar tracking device may also be associatedwith the patient tracker 58 to allow for correlation to a radar trackingsystem which may define a third coordinate system.

At an appropriate time, such as after registration of the image data tothe first coordinate system and/or correlation between the firstcoordinate system and the second coordinate system, identification ordetermination of correspondence between the individual tracking devicesand the segmented portions in the image is made in block 294. Theidentification in block 294 may be understood to allow for anassociation of a specific segmented portion in the image 108, such asthe segmented image portion of the vertebra 166 i′, to be associated orrelated to a specific vertebra 166 i of the subject. It is understoodthat any other appropriate association of members may also be made.

As discussed above, the individual portions in the image, such as theindividual vertebra 166 may have one tracking device 160 attachedthereto. As also discussed above, the individual tracking devices may betracked in any appropriate tracking system. However, as illustrated inFIG. 2 and FIG. 3, the individual tracking devices 160 may be tracked ina single manner, such as with the EM localizer 94. Other instruments,such as the instrument 68, may be tracked with a different trackingsystem, such as the optical tracking system 88. Accordingly, theregistration of the first coordinate system may be with the opticaltracking system, and the second coordinate system may be the EM trackingsystem. Accordingly, the correlation between the first coordinate systemand the second coordinate system may allow for the tracking in thesecond tracking system to be related to the image data that isregistered in block 286. Thus, if the individual tracking devices 160are tracked relative to the second coordinate system, the identificationor determination of correspondence in block 294 may occur after thecorrelation in block 290.

The identification or determination of the individual tracking devices160 relative to each of the vertebrae 166 may occur as discussed above.For example, the user 72 may identify each of the tracking devicesindividually relative to each of the vertebrae images 166 i′, 166 ii′and 166 iii′. Thus, the navigation system 20 may identify which of thegraphical image portions or segmented portions to relate to each of theindividual tracking devices. It is understood, however, that theindividual tracking devices may also be automatically related to theindividual segmented portions. For example, the patient tracker 58 maybe determined or known to be the most inferior trackable portion andthat an individual tracking device may be attached to each vertebraemoving superiorly therefrom. Accordingly, the navigation system 20 mayidentify the patient tracker 58 and then identify, in sequence, eachindividual tracking device a distance from the patient tracker 58 wherethe closest tracking device is in the closest vertebra, the next closesttracking device in the next closest vertebra, and so forth. Accordingly,the navigation system 20 may also identify the segmented elementsrelative to each of the tracking devices substantially automatically inthe operating theater.

The individual tracking devices, including the individual trackingdevices 160 connected to the member, such as the vertebra 166, theinstrument tracking device 66, and other tracking devices are tracked inblock 298. Tracking the tracking devices in block 298 may includedetermining positions of the tracking devices in the navigation space.Tracking the tracking devices in block 298 allows for determination ofpositions of portions that are connected to the tracking devices, suchas the individual member portions including the vertebrae 166.Accordingly, in block 304 the image 108 may be updated, including thesegmented image portions thereof, may be updated based upon the trackedpositions of the individual tracking devices. As illustrated in FIG. 4and FIG. 5, the image portions of the vertebrae 166 i′ and 166 ii′ maybe displayed based upon a tracked position of the tracking devicesassociated thereto. Thus, the tracking devices 160 track the relatedportions, such as the vertebrae 166, which may be moved and the imageportions 166′ related thereto may be changed or updated on the image 108displayed on the display device 64.

The user 72 may then move the vertebrae and/or instruments 68 relativeto the subject in block 308. As discussed above, the instrument 68 mayinclude any appropriate instrument such as a tap and/or implant to bepositioned relative to the subject 30. The user 72 may move theinstrument 68 relative to the subject and the graphical display or icon68′ may be displayed on the display device, as illustrated in FIG. 4 orany appropriate representation of the instrument 68 may be illustrated.Further, movement of the subject 30 may be illustrated on the displaydevice 84 by updating the image 108, as discussed above.

In various embodiments, measurement and/or illustration of selectedmeasurements, such as the angle 192, distances 184, 188, or otherappropriate measurements may be made in block 310. These measurementsmay be displayed on the display device 84, such as with graphical blockrelative to the image 108 including a discrete or small graphical block312 and/or a ledge in 316. Accordingly, the user 72 may review thevarious measurements based upon the segmentation of the image 108 and/ormovement of the various portions of the subject 30 and/or tracking ofthe instrument 68.

In various embodiments, as noted above, the members or elements in thenavigation field may be tracked with individual trackers connectedthereto. Further the portions or members moved relative to the subject30 may also be tracked with a plurality of tracking devices. Asdiscussed above, the instrument 68 may be tracked relative to thesubject 30 with the instrument tracking device 66.

As also discussed above, the instrument 68 may represent a plurality ofinstruments, such as ones assembled of a plurality of members. Invarious embodiments, therefore, different portions of the instrument 68may be connected together and each of the different portions or membersmay have a tracking device associated therewith. In this regard, withreference to FIG. 3, the instrument 68 may include the instrumenttracking device 66 and a second instrument tracking device 320. Thesecond tracking device 320 may be of a type similar to the EM trackingdevice 66 e, or be any appropriate tracking device. Nevertheless, thesecond instrument tracking device 320 may be used to track a portion ormember of the instrument 68 spaced apart or away from the connectionpoint of the instrument tracking device 66 to the instrument 68. It isunderstood, that a plurality of tracking devices may also be associatedwith various other members, such as implants, particularly movable oradjustable implants that may have portions that move relative to oneanother either intentionally or unintentionally.

Turning reference to FIG. 7, the patient tracker 58 may be connected tothe subject 30 in a selected location, such as near the tail bone oriliac crest. The other trackers may be connected relative to the subject30 at other appropriate locations, such as to the vertebrae 166. Thevertebrae 166 may have distinct and separate tracking devices connectedthereto, as may be provided in various embodiments. As discussed herein,each of the various tracking devices may vary in size, geometry, shape,color, tracking modality, etc.

In various embodiments, as illustrated in FIG. 7, tracking devices areillustrated that may be provided or used in addition to or alternativelyto the tracking devices 160. For example, a first tracking device 330may be connected to the first vertebrae 166 i, a second tracking device334 is connected to the second vertebrae 166 ii and a third trackingdevice 338 may be connected to the third vertebrae 166 iii. Each of thetracking devices 330, 334, 338 may be within a field of view ornavigation space of the optical localizer 88. The optical localizer 88may include a plurality of cameras, such as a first camera 340 and asecond camera 344. The cameras 340, 344 may view the field of view thatmay define all or a portion of the navigation space. The navigationsystem 20, therefore, may view the field of view or analyze the field ofview to identify the individual tracking devices 330-338.

Each of the tracking devices 330-338 may include distinct shapes orgeometry, such as triangles or other geometric shapes that are differentfrom one another. For example, the first tracking device 330 may have atracking element or member 348 that is an acute triangle. The secondtracking device 334 may have a trackable element 352 that is an obtusetriangle. Finally, the third tracking device 338 may include a trackableelement 356 that is a parallelogram. Each of the trackable elements 348,352, 356 may, therefore, be identified in the field of view by thenavigation system 20. As discussed above, each of the trackable devices330-338 may be associated with respective vertebrae 166. Therefore, thenavigation system may track the tracking devices 330-338, substantiallyseparately and individually, and relate or alter the display device 84to display the image 108 regarding a substantially real time position ofthe respective vertebrae 166, or the member to which the respectivetracking devices are connected. In addition to the altered shape ordifferent shape of each of the tracking portions 348-356, each mayinclude a different color, shade, or the like that may also beidentifiable in the field of view. Accordingly, each of the individualtracking devices may be identified by both a shape and/or color during aselected tracking procedure.

With continuing reference to FIG. 7, tracking devices may also includeor alternatively include a fourth tracking device 360 and a fifthtracking device 364. Each of the tracking devices 360, 364 may beconnected to selected individual vertebrae or members, such as a fourthvertebra 166 iv and a fifth vertebra 166 v. It is also understood thatthe tracking devices 360, 364 may be used in place of alternatively tothe tracking devices 330, 334, 356 or other appropriate tracking devicesas discussed above.

The tracking device 360, 364 may include respective trackable elementsor members 368 and 372. The trackable element 368 may include a firstpattern or light altering characteristic that may be known. For example,the navigation system 20 may include a database that includes thepattern of the trackable portion 368. In addition the trackable portions348, 352, 356, as discussed above, may also be included in the database.The second trackable portions 372 may include a different pattern orlight changing characteristic. Selected camera or lens features, such asa plenoptic camera or when using a structured light emitter, may be usedto identify the differentiation of the light reflected from thetrackable portions 368, 372. The trackable portions 368, 372 may includea three-dimensional pattern formed on to the trackable portions 368, 372that may alter light emitted therefrom or reflected thereby. Theselected camera 340, 344 may be used to identify the type of reflectedlight and identify the specific tracking members 360, 364. For example,a plenoptic camera may include a plurality of lenses positioned awayfrom a focus plane to analyze light encountering a photo cell or lightreceiver (e.g. a complementary metal-oxide semiconductor sensor). Byanalyzing the reflected light the navigation system 20 may be able toidentify the specific tracking device 360, 364. As discussed above, eachof the individual tracking devices may be associated with individualvertebrae, such as the fourth and fifth vertebrae 166 iv and 166 v. Thusthe navigation system 20 may identify the specific vertebrae and updatethe image 108 based upon the tracked position of the tracking devices360, 364.

With continuing reference to FIG. 7, still further or alternativetracking devices may include a tracking device 380 and a tracking device384. Each of the tracking devices 380, 384 may have trackable portions386, 388, respectively. Each of the trackable portions 386, 388 may besubstantially three-dimensional or have depth to alter or change thedirection of light being reflected. Thus, each of the trackable portions386, 388 may be identified based upon the direction or altered orpredicted type of reflected light. For example, the trackable portion386 may reflect light from a source along a first ray 392. The secondtrackable portion 388 may reflect light along a second ray 396. As thetwo rays represent, the trackable portions may reflect light indifferent directions. The light may be from a single source 398 and thecameras 340, 344 of the localizer 88 may identify the specific lightreflection to identify the respective tracking device 380, 384. Asdiscussed above, the various portions of the trackable portions 386, 388may also be altered or differentiated by color, reflection features, orthe like.

Thus, the respective and individual tracking devices 380, 384 that maybe connected to different and separate vertebrae 166 vi and 166 vii maybe used to identify the respective vertebrae during a trackingprocedure. As discussed above, the navigation system 20 may then updatethe image 108 to identify movement of position of the respective membersof the subject 30, such as the vertebrae 166. The updated image may bebased upon the tracked location of the respective and individualtracking devices 380, 384.

It is understood that appropriate types of tracking devices may beassociated with a vertebrae 166 in any appropriate manner and mayinclude electromagnetic or convective coils (EM) that may be used tosense a field and transmit a signal thereon. Identification of theindividual tracking devices may include a signal regarding each of theindividual tracking devices. In a wired transmission, the individualsignal may relate to the specific tracking device transmitted with awire or physical connection. In a wireless transmission system, selectedidentification features may be added to the transmitted signal toidentify the specific tracking device transmitting the signal. Examplesinclude a tracking device serial number or a hard-coded universallyunique identifier (UUID). Other possible tracking devices may alsoinclude radar tracking devices, radio frequency tracking devices,ultrasonic tracking devices, or the like.

In addition to tracking each of the respective vertebrae relative to aselected reference, such as the patient tracker 58, each of therespective tracking device may be used as reference markers for trackingother elements relative to them. For example, the first tracking device330 may be tracked relative to the second tracking device 334, once bothare registered within the navigation coordinate system. As discussedabove, the patient tracker 58 may be registered to the image 108 and mayinclude a plurality of trackers such that the selected type of trackerof the tracking devices connected to the individual, including thoseillustrated in FIG. 7 and those discussed above may be tracked relativeto the patient tracking device 58 and/or other tracking devices in thenavigation field.

In various embodiments, a plurality of types of trackers may be dividedas the tracking devices associated relative to the subject 30 forassisting in tracking a plurality of types of procedures. As illustratedin FIG. 7 and in the Figs above, trackable portions may be connected tomembers that are fixed directly to bony portions, such as the vertebrae.Each of the tracking devices may include pins, screws, or the like thatare fixed to the bony portions and the tracking devices may extendthrough soft tissue of the subject, such as a dermis or muscle thereof.As illustrated in FIG. 7 and phantom, therefore, a dermal layer 30 d maycover a portion of the vertebrae 166 such that the trackable portion 358extends past the dermis and a pin or connection member 367 extends intothe vertebrae 166 iii. It is understood that the other tracking devicesmay include a similar connection mechanism such that the trackableportions extend above the dermal layer 30 d. In various embodiments,however, the trackable portions of the tracking devices may be connectedto the vertebrae and alternative and/or additional manners.

In various embodiments, as illustrated in FIG. 8, implants may bepositioned relative to the subject 30. As discussed above, the implantis the instrument 68. In various embodiments, however, an implant mayinclude a fastener, such as a pedicle screw 410. The pedicle screw mayinclude various portions, such as a shank 414 and a head 418. Thepedicle screw 410 may be any appropriate pedicle screw such as a pediclescrew sold with the CD Horizon® Spinal System sold by Medtronic, Inc.having a place of business in Minnesota, USA. The pedicle screw mayallow the head 418 to move relative to the shank 414.

The pedicle screw 410 may include tracking members, such as a first orhead tracking member 422 and a second or shank tracking member 424. Thetracking members may be tracked by the tracking system in the navigationsystem 20. In various embodiments the tracking members 422, 424 may beEM tracking members.

Other trackable devices may include an intervertebral device such as aPrestige® disc replacement or disc implant and/or a Bryan® discreplacement or disc implant, both sold by Medtronic, Inc. Anintervertebral device 430 may be positioned between two vertebrae, suchas to be positioned between and/or in contact with the end plates 170,174, as discussed above. It is understood that various intervertebralimplants may include surgical implants, lumbar implants, or the like.Generally the intervertebral implant 430 may include a first end plateor contact side 434 and a second implant or contact side 436. Positionednear or adjacent to the two sides 434, 436 may be tracking devices suchas a first tracking device 438 and a second tracking device 442. Again,the tracking devices 438, 442 may be EM tracking devices to be trackedwith the navigation system 20.

In either instance the tracking devices 422, 424, 438, 442 may be usedto track the position or relative position of different portions of therespective members 410, 430. For example the two tracking devices 422,424 may be used to track the relative position of the head 418 to theshaft 414. The tracking devices 438, 442 of the intervertebral implant430 may be used to show the distance between the two surfaces 434, 436or relative angles thereof, or the like.

Further, the tracking devices associated with the implants 410, 430 maybe used during a procedure. For example, the pedicle screw 410 may bepositioned into a vertebrae, such as the vertebrae 166 i. The trackingdevices in the screw 410 may be used to track the screw as it ispositioned within the vertebrae 166 i. Once the screw 410 is positionedwithin the vertebrae 166 i the tracking devices or a selected one of thetracking devices on the screw 410 may then be used as the trackingdevice for the particular vertebrae, in addition to or alternative tothe tracking devices (e.g. 160 as discussed above) as discussed above.Similarly the tracking devices 438, 442 of the intervertebral device 430may be used to track the intervertebral device 430 that is positionedand then tracked relative to the vertebrae once positioned. It isunderstood that other appropriate implants may also include trackingdevices and may also be used as individual member tracking devices oncepositioned in the subject.

Turning reference to FIG. 9 the vertebrae 166 i is illustrated. Invarious embodiments, as discussed above, a pilot bore or a hole 450 maybe formed into the vertebrae 166 i for various purposes, such aspositioning the pedicle screw 410 therein. A drill instrument or drillbit 454 may be used to form the bore 450. The drill instrument 454 maybe formed to include a trackable portion 458 to track the drill duringforming the bore 450. After forming the bore 450, the trackable portion458 may be disengaged or removed from the drill bit 454 and remain inthe bore 450. Accordingly, the tracking device 458 may remain in thebore 450 for a selected portion of a procedure and/or after implantationof other members. In various embodiments, the tracking device 458 is atracking device tracked by the EM localizer 94. The tracking device 458may include one or more coils of conductive material.

The trackable portion 458 that disengages from the drill bit 454 may beused as the tracking device to track the individual vertebrae 166 i. Itis understood that other appropriate instruments may be used to performa first portion of a procedure on a selected member and the drill bitand the vertebrae are merely exemplary. Nevertheless, a tracking portionincluded in the first instrument portion may be disengaged and remain inthe selected member, such as the vertebrae, for further portions of aprocedure. The remaining tracking portion may be used as the trackingdevice for the additional portions of a procedure either alone or inaddition to the other tracking devices that may be connected externallyto the vertebrae or other member.

It is understood that other appropriate members may also includetracking portions that may either be used to track the instrumentrelative to the subject 30 and/or particular members thereof such as thevertebrae 166, or other implants. For example, retractors, taps, awls,and the like may engage selected portions of the anatomy eithertemporarily or during an extended period during a procedure. The trackedportions may be identified with respective portions of the anatomy andmay be used to track the specific portions of the subject during theselected portion of the procedure. By tracking the individual portionsduring the procedure, the image 108 may be updated to illustrate thetracked real time position of the selected member to which the trackingdevice is connected or associated with.

Turning reference to FIG. 10, as discussed above, one or more elementsor portions, such as bony members including vertebrae, may have atracking device associated therewith. The tracking device may also beused as the patient tracker or reference frame for tracking relativethereto with another instrument. As discussed above the instrument 68may be moved relative to the subject 30 during a selected procedure.

As illustrated in FIG. 10 and with reference to FIG. 1 and FIG. 3, thefirst tracking device 160 i may be connected to the first vertebrae 166i and a second tracking device 160 ii may be connected to the secondvertebrae 166 ii. The instrument 68 may be tracked relative to thesubject 30 during a selected procedure. As illustrated in FIG. 10, theinstrument 68 may be movable relative to the subject 10, such as beingpositioned near the first vertebrae 166 i. When positioned near thefirst vertebrae 166 i the nearest tracking device 160 i may be used as areference frame for tracking the instrument 68 relative to the firstvertebrae 166 i. The instrument 68 and/or a separate instrument, such asan instrument 470 may be positioned near the second vertebrae 166 ii.The instrument 470 may be identical or different than the firstinstrument 68. Nevertheless, the second tracking device 160 ii may bethe tracking device nearest to the instrument 470 and, therefore, may beused as a reference frame to track the instrument 470 relative to thesecond vertebrae 166 i.

It is understood, however, in various embodiments, that only the singleinstrument 68 may be tracked for a selected portion of a procedure orfor a procedure and may be moved between the first vertebrae 166 i andthe second vertebrae 166 ii. Accordingly, the selection of the trackingdevice to use as the reference frame may be based upon the determinationof the tracking device closest to the instrument 68 during a portion ofa procedure. The closest tracking device selected for reference mayincrease accuracy of tracking the instrument relative to a selectedmember, such as the vertebra 166.

In various embodiments the single patient tracker 58 may be used as areference frame. Providing the individual tracking devices 160 on theindividual portions allow for each of the individual tracking devices tobe used as reference devices once they are registered in the navigationspace, as discussed above. Accordingly, the selection of the referencedevice may be switched between the patient tracker 58, the firsttracking device 160 i, the second tracking device 160 ii, or otherappropriate tracking devices.

In addition to and/or alternatively to selecting the nearest trackingdevice to the instrument being tracked, a selection of an assumed fixedtracking device may be made based upon the highest quality ofmeasurement. Accordingly, with continuing reference to FIG. 10 andtracking the instrument 68, either the first tracking device 160 i, thesecond tracking device 160 ii, or the patient tracker 58 may be used asthe reference tracking device for tracking the instrument 68. Theselection of the tracking device for reference in tracking of theinstrument 68 may be based upon a quality of the tracking of theselected tracking device connected to the subject 30. The quality of thetracking may be based upon an error in geometry, signal strength, or thelike. For example, as discussed above, the tracking device 160 i may beprovided as any appropriate tracking device such as the tracking devices330, 334, 338. Each of the tracking devices have known geometries thatmay be used to identify the tracking devices in the navigation space. Alowest error of geometry may be used to determine the tracking devicesto be best used as a reference for tracking the instrument 68 relativeto the subject 30. Additionally, determination of interference with asignal (e.g. eddy EM fields) may be used to determine the trackingdevice as the selected reference device.

In various embodiments, a greater confidence or quality may be madebased on the tracking device with the least error, including geometryerror. Error may be measured as an average or root-mean-square of thedifferences in measured vs. expected tracking device positions. Forexample, in an EM tracking device the coils are at known and fixedpositions relative to one another. Thus, each coil may be tracked andthe entire information may be used to determine the position of thetracking device. However, each coil position may be tracked relative toeach other and thus, the known and tracked positions may be used todetermine quality of the tracking information. Noise or spuriousspectral components could also be used to weight a measurement by signalquality or the presence of interference. Measured signal phases may bealso used to evaluating single quality.

Thus, providing a plurality of the tracking devices, such as the firsttracking device 160 i and the second tracking device 160 ii, in thesubject 30 allows for an ability to select different tracking devicesfor referencing tracking of the instrument 68 relative thereto. Theselection may be made substantially automatically and/or manually (e.g.by a user) during a selected procedure. For example the navigationsystem 20 may receive the tracking signal for each of the trackingdevices during a selected procedure. As the instrument 68 is trackedrelative to the subject 30 the navigation system 20 may determine alowest error relative to a plurality of tracking devices connected tothe subject 30. Error may be determined by comparing measured vs.expected fiducial properties, including physical dimensions andgeometry, color, texture, signal spectral composition and phase, etc. Atracking system 20, therefore, may automatically select the trackingdevice with the lowest error for navigating or tracking the instrument68 relative to the subject 30. Similarly the tracking system 20 maymeasure the distance between the instrument 68 and other trackingdevices in the navigation space and select the tracking device closestto the instrument 68 as the tracking device for referencing tracking theinstrument 68. Alternatively and/or in combination therewith, the user72 may select and/or validate or confirm selection of tracking devicesfor navigating the instrument 68.

With continuing reference to FIG. 10 and further reference to FIG. 7,discussed above, a plurality of tracking devices may be connected toeach of the portions of the subject 30. For example, as illustrated inFIG. 10, the vertebrae 166 i may be connected to the first trackingdevice 160 i and the tracking device 330. Similarly, the secondvertebrae 166 ii may be connected to the tracking device 160 ii and thetracking device 334. Each of the respective tracking devices may beconnected at the same point, such as a tracking device or referencepoint 480 on the first vertebrae 166 i and a second tracking orreference point 484 on the second vertebrae 166 ii. Accordingly, the twotracking devices 330 and 160 i are connected at the single trackingpoint 480. Similarly the two tracking devices 334 and 160 ii areconnected at the second tracking point 484.

The two different tracking devices may be tracked in different trackingmodalities, such as the EM tracking devices 160 i and 160 ii and thesecond tracking portion may be optical tracking device portions 330,334. Thus, two different tracking systems, including the opticallocalizer 88 and the EM localizer 94 may be used to track the samepoints 480, 484. It is understood that a plurality of a type of trackingdevices may be connected together and that the same tracking points,such as including radar tracking devices, acoustic tracking devices, andthe like. The instruments, such as the instrument 68, may include onlyone or a plurality of the tracking device modalities relative thereto.Regardless the navigation system 20 may be co-registered relative to theselected portions, such as the individual vertebrae 166 due to theplurality types of tracking devices at the single or tracking points480, 484.

It is understood that each of the vertebrae or each appropriate memberor portion of the subject may have the tracking devices connectedthereto. Accordingly during a procedure, the selection of the besttracking device for reference may also be made based upon the trackingsystem having the greatest confidence of tracking data regarding thereference device. The greatest confidence may be based upon a comparisonof confidence levels of tracked positions of various different trackingdevices. Confidence may be based on geometric error of the trackingportions alone and/or relative to each other, predicted light (visibleor invisible (e.g. infra-red) shaped or diffraction, signal strength orsignal to noise ratio, or other considerations. The confidence for eachtracking device may be determined at a selected rate during a procedureand used for various purposes, as discussed herein.

During navigation of the instrument 68, the instrument 68 may be trackedwith an optical system that tracks the optical tracking device 66 owhile the vertebrae 166 i is tracked with the EM tracking device such asthe tracking device 160 i. The two tracking systems may be co-registeredor correlated due to the prior registration of the tracking devicerelative to the vertebrae 166 i either individually and/or with thepatient tracker 58. The EM localizer 94 may be used to track thevertebrae 166 i with the EM tracking device 160 i and the opticaltracking system with the localizer 88 may track the instrument 68 withthe optical tracking device portion 66 o. The position of the vertebrae166 i and the position of the instrument 68 may be illustrated as agraphical representation, either superimposed on or by altering thesegmented image 108, discussed above.

The multiple tracking portions of the tracking devices allow thetracking of the instrument 68 relative to the vertebrae 166 i based uponone or a plurality of tracking devices in the navigation system 20. Itis understood that a plurality of instruments may also be tracked andthat the specific type of tracking system may be selected upon the user78 or other appropriate selections and the above is merely exemplary.Nevertheless, the vertebrae 166 i may be tracked with a first trackingmodality (e.g. EM tracking) and the instrument 68 may be tracked with asecond tracking modality (e.g. optical tracking). The two trackingsystems may be co-registered, as discussed above, and allow forillustration of the respective positions of the vertebrae 166 i and theinstrument 68 to be displayed on the display device 84, as discussedabove.

The correlation of the tracking systems may allow the tracking deviceportion 66 o to be tracked by the optical tracking system relative tothe vertebra 166 i tracked with the tracking device 160 i which may bean electromagnetic tracking device tracked by the EM localizer 94.Although the two tracking systems may include different localizersoperating under different modalities (e.g. optical and different fromelectromagnetic), the tracked position of the instrument 68 relative tothe vertebrae 166 i may be known due to the correlation between the EMtracking system and the optical tracking system and related coordinatesystems. The relation can be due to the tracking device connected to thesingle point 480 on the vertebrae 166 i including both the trackingdevice 160 i which may be an EM tracking device and the tracking device330 which may be an optical system tracking device. Additionally, thetracking device 58, discussed above, may include both EM and opticaltracking portions which allow for co-registration or correlation betweenthe two tracking systems. The correlation may be made at any appropriatetime, such as initially, or during a procedure. The correlation may bemade where the two tracking systems (or any appropriate number oftracking systems) may track or determine a single position to allow forcorrelation between the coordinate systems of all the tracking systems.

As discussed above, the instrument 68 includes the tracking device 66that may include one or more tracking portions, such as an opticaltracking portion 66 o and an EM tracking portion 66 e. Accordingly, theinstrument 68 may be tracked with both of the localizers 88, 94substantially simultaneously. The two localizers having the tworespective coordinate systems may be correlated, as discussed above.

Tracking the instrument 68 in the two coordinate systems may be used toassist in increasing confidence of a tracked position of the instrument68. The tracked position of the instrument 68 may be tracked with thetwo tracking systems and the tracked location may be confirmed and/orincreased in confidence by tracking with the two tracking systems and/orselecting the tracking system with the least amount of error. Further,the instrument 68 may be tracked substantially continuously, therefore,regardless of interference with either one of the tracking systems. Inaddition, moving the instrument 68 through space and maintainingtracking it with the two tracking systems may allow for determination ofpossible interference in different areas of space to either or both ofthe tracking systems. It is understood that any appropriate number oftracking systems may simultaneously track the instrument 68, and the twotracking systems is merely exemplary.

In addition, the tracking information may be combined from the two ormore tracking systems in various approaches. In various embodiments,combining the tracking information may include a sensor fusion approachby applying a central limit theorem or Kalman filtering to the trackingdata to determine a tracked position of the instrument 68. Regardless,the tracked position of the instrument 68, or any appropriate portion towhich two or more tracking portions allow two or more tracking systemsto tracked, may be tracked substantially simultaneously with two or moretracking systems to attempt to increase the confidence and/or precisionof a tracked position to which the tracking device is connected.

Further, the instrument 68 may be localized within the trackingcoordinate system by positioning it relative to a known point, such asthe patient tracker 58. The patient tracker 58 may include a referencepoint or portion 500, similar to the reference point 150, that may becontacted by the instrument 68. Once the instrument 68 contacts thepoint 500 the respective tracking systems may register or coordinate theinstrument 68 within the navigation spaces. For example, if the patienttracker 58 includes both optical and EM tracking systems the correlationbetween the tracking systems may be determined and once the instrument68 touches the instrument portion at point 500. Even if the position ofthe instrument 68 is tracked with the optical tracking system, with theoptical tracking portion 66 o only, the correlation allows theinstrument 68 to be tracked in the optical tracking system with theoptical localizer 88 and to correlated to the EM coordinate system.

Further, the tracking devices on the instrument 68 may be registered ordetermined by positioning or contacting the instrument 68 with the point500. The patient reference 58 may be determined in the navigation spaceand the tracked position of the tracking portion, such as the opticaltracking portion 66 o may be determined relative to the reference point500 once the instrument 68 contacts the reference point 500. This mayallow the determination of the tracking portion 66 o position relativeto a selected portion of the instrument 68, such as a distal or terminalpoint thereof. It is understand that the determination of trackingportions in any appropriate member may be performed in a similar manneror by contacting any appropriate reference point, such as an implant(e.g. a pedicle screw). As an alternative, or in addition thereto, thetracking device 66 o, or any appropriate tracking device, may bemanufactured or mounted to the instrument 68 at a known or predeterminedposition. The navigation system 20 may then recall the known andpredetermined position to determine a point of the instrument orportions or geometry of the instrument relative to the tracking portion66 o.

Positions of various tracking devices may also be determined relative tothe members of the subject 30, such as the tracking device 160 i byimaging the subject 30 and identifying the tracking portion in theimage. The tracking portion may be identified in the image automatically(e.g. by segmentation of a known geometry), semi-automatically (e.g.user selecting a selected pixel or voxel in a segmentation basedthereon), or by a manual selection by the user. Regardless, theidentification of the location of the tracking portion 160 i (or anyappropriate tracking device) may be determined in the image. Thus, whenupdating the image 108 the known position of the tracking device may beused to assist in determining an appropriate position (e.g.three-dimensional position and appropriate number of degrees of freedomof orientation) in the image.

Turning reference to FIG. 11, the subject 30 may include a plurality ofportions, such as the plurality of vertebrae 166 that may be of interestfor a selected procedure. During the selected procedure various trackingdevices, such as the patient tracker 58 may be connected relative to thesubject 30 along with other appropriate tracking devices such as a thirdtracking device portion 160 iii and a first tracking device portion 160i. As illustrated in FIG. 11A, the first tracking device portion 160 iis connected to the first vertebrae 166 i. The third tracking device 160iii is connected to the third vertebrae 166 iii. The second vertebrae166 ii, however, may have no tracking device connected thereto. Asdiscussed above, the identification of the selected portions of thesubject 30 to which tracking devices are connected may be performed invarious manners, such as through automatic identification, manualidentification, or the like. Nevertheless, the navigation system 20 mayillustrate directly the position of the first vertebrae 166 i and theposition of the third vertebrae 166 iii either alone or relative toother portions of the anatomy in the image 108. As discussed above,tracking the movement or position of the respective tracking devices,160 i and 160 ii, may allow for direct determination of current ortracked positions of the respective vertebrae to which they areattached.

The second vertebrae 166 ii, however, may also be indirectly tracked orhave its position estimated relative to either or both of the firstvertebrae 166 i and the second vertebrae 166 iii. For example, the image108, as illustrated in FIG. 11B all of the vertebrae as images includingsegmented portions of the vertebrae and/or graphical representationsthereof. Thus, the first vertebrae is illustrated as the first vertebraeimage portion 166 i′, the second 166 ii′, and the third vertebrae 166iii′. As the tracking devices are associated with the differentvertebrae, the navigation system 20 may measure a distance betweenselected portions, such as a centroid 520 of the first vertebrae image166 i′, a second centroid 524 of the second vertebrae image 166 ii′, anda third centroid 528 of the third vertebrae image 166 iii′. Each of thecentroids may be measured relative to one another to allow fordetermination of the closest pairwise position between the trackedvertebrae 166 i and 166 iii, and the second vertebrae 166 ii. It isunderstood that other appropriate portions may be measured between theimage portions, such as pedicles, spinous processes, or otherappropriate determined or identified portions in the image. Further, asnoted above, endplates of the vertebrae and/or geometries associatedtherewith such as lines or planes may be determined and illustrated.These may also be used to display and/or determine position and movementof the vertebra in the image 108. The navigation system may includeappropriate instructions to segment and/or identify selected portions ofthe anatomy of the vertebrae in the image 108 and/or other appropriateportions for measuring comparative distances between image portions.

The navigation system 20 may also include information regarding whichportions are directly tracked, such as either automatic or manual inputas discussed above. Thus the closest portion or tracked portion to theuntracked portion may be determined. For example, the navigation systemmay measure the distance between the first centroid 520 and the secondcentroid 524 and make a determination that it is the shortest distance.Accordingly, an inference may be made of the position of the secondvertebrae 166 ii relative to the first vertebrae 166 i based upon thedirectly tracked position of the first vertebrae 166 i.

The image 108 may therefore be updated with the selected position of thesecond vertebrae 166 ii based upon the direct tracking of the closestvertebrae. For example, the position of the second vertebrae 166 ii mayassume to be moved from an initial or originally segmented positionwithin a selected threshold of the directly tracked position of theclosest vertebrae, such as having a translation movement (e.g. delta) ofabout 70% to about 90% of the directly tracked portion. In variousembodiments, selected portions may be assumed to move or have a deltatranslation of exactly the same amount of a selected tracked portion.Thus, the second vertebra 166 ii may be illustrated to move in the sameamount and manner of the a selected vertebra, such as the vertebra 166i.

Further, a determined position of the untracked vertebrae 166 ii may bebased upon an interpolation between the two directly tracked vertebrae.For example, the position of the first vertebrae 166 i is known directlyfrom the first tracking device 160 i and the precise position of thethird vertebrae 166 iii is known directly from the tracked position ofthe third tracking device 160 iii. The position of the untrackedvertebrae 166 ii may be based upon a selected function of the knownposition of the two vertebrae on either side of the untracked vertebrae166 ii.

The interpolation function may be any appropriate function and may bedetermined by the user during a selected procedure and/or predeterminedbased upon a biomechanical model of the known or suspected movement of avertebrae between two adjacent vertebrae, particularly in a selectedportion of the anatomy. For example, the interpolation may be a directinterpolation, such as in a line or plane between the first vertebraeimage 166 i′ and the third vertebrae image 166 iii′. Thus, if the firstvertebrae 166 ii is tracked to a first angular orientation 540 and thethird vertebrae 166 iii is tracked to a second angular position 544,then an interpolated angular position of the second vertebrae 166 i maybe determined to be generally equal distance between the first angularposition 540 and the second angular position 544 and generallydetermined to be at an angular position 548. The angular position 548may be a first distance 552 and a second distance 554 from the secondangular position 544. Thus, the third angular position 548 may besubstantially between the first angular position 544 and the secondangular position or line 544. According to various embodiments,spherical linear interpolation may be a specific method one might use tointerpolate the rotational components of two different transforms.

Alternatively or in addition thereto, a biomechanical model may be usedto determine and/or update or refine the interpolated or estimatedposition such as a model based upon known muscle or soft tissueinteractions, range of motion limitations or determinations, or otherappropriate known or determined biomechanical features. In variousembodiments, the biomechanical features may include rigid body dynamics,collision response, Hooke's law or more advanced models of interactionbased on empirically determined material properties (either general orpatient-specific), finite element modeling, and any combination of theabove.

As discussed above, with reference to FIGS. 11A and 11B, an untrackedelement or portion in the navigation space may have its positioninterpolated or determined between two tracked portions and/or relativeto a single tracked portion. Similarly, an instrument may have aplurality of portions that may be positioned or movable relative to oneanother. In addition, an implant may include more than one portions,such as a pedicle screw and interconnecting rod, a multi-pieceinterventricular disc, a femoral implant and a tibia implant for a totalknee replacement, or other implant systems. The position of a anuntracked portion may be determined based upon tracking of a closestportion, interpolation between two tracked portions, and based upondeterminations of selected or known moving ability of one piece relativeto another. Accordingly, untracked portions of instruments may also betracked when interpolated with a tracking system.

With reference to the figures above, and with exemplary reference toFIGS. 11A and 11B, the tracked portions of the navigation field may beused to update the display 84 of the image 108. It is understood thatany appropriate portions may be viewed on the display which may includethe vertebral portions, such as the first vertebrae 166 i displayed asthe vertebrae 166′. As the vertebrae 166 i moves in the navigationspace, its position may be updated on the display 84, such that theimage 108 will change to show movement of the vertebral display portion166 i′. The movement can be determined based upon tracking the firsttracking device 160 i relative to a selected reference, such as thethird tracking device 160 iii and/or the patient tracker 58.

Movement of the vertebrae 166 i may be in any appropriate translation orrotational position, for example including angular movement to anexemplary position, including 166 i′a. When the display 84 is update andthe image 108 is changed, the previous position of the implant portion166 i′ may not appear such that only the presently tracked position ofthe vertebrae 166 i is displayed. It is understood that other positionsare also updated on the display 84, such as positions of the trackedinstrument 68 may be displayed on the display as a graphicalrepresentation 68′.

Such changes may occur as implants or members are positioned in thesubject 30, such as an intervertebral body 600, as illustrated in FIG.11A. An intervertebral body may be moved or positioned between the firstvertebrae 166 i and the second vertebrae 166 ii. The intervertebral body600 may be displayed on the display device 84 relative to the image 108as a graphical representation 600′. The graphical representation 600′ ofthe intervertebral body 600 may be displayed based upon a trackedposition of the intervertebral body 600 directly such as with a trackingmember 604 positioned in the intervertebral body similar to thatdiscussed above. Further, as the adjacent or contacted vertebrae and/orother appropriate portions are also tracked to the position of thevertebrae may also be illustrated on the display device 84.

With continuing reference to FIGS. 11A and 11B and additional referenceto FIGS. 12A and 12B, the display 84 may also be updated with selectedimages. For example, the image 108 may be updated overtime such as toillustrate or display the first image 108 i and a second image 108 ii.The second image 108 ii may include a change of the displayed positionof the vertebrae 166 i′ and 166 ii′ to show movement of the vertebraerelative to one another, implants positioned relative to the vertebrae,and other appropriate information.

For example, as illustrated in FIG. 12A lines 610 and 612 may representrespective endplates 616 and 618 of the respective vertebrae 166 i′ and166 ii′. As discussed above, the endplates and/or planes or lines may bedetermined due to segmentation and the lines 610, 612 may be alsodetermined and then displayed in the image 108 i. A first angle 622 maybe displayed as determined between the lines 610, 612. Aftermanipulation of the subject 30, such as movement of the vertebrae 166 iand 166 ii, the image may be updated as 108 ii illustrated in FIG. 12B.The movement of the vertebrae 166 may be due to positioning of animplant, such as the intervertebral implant 600, illustrated in FIG.11A, manual manipulation of the spine, implantation of a fusion system,or other appropriate changes. Nevertheless, the image 108 i may includethe lines 610 and 612 relative to the respective vertebrae 166 i′ and166 ii′.

A second angle 630 may be displayed between the two lines 610, 612. Thesecond angle 613 may be analyzed for determination of a selected angleor comparison to a planned angle, an a priori angle, or otherappropriate determination. For example, the user 72 may determine adesired angle or selected angle between the two vertebrae 166 i and 166ii and the user may view the display 84 to determine whether the secondangle 630 is the selected angle. If not, the manipulation of thevertebrae may be further performed in an attempt to achieve the selectedangle.

Nevertheless, due to tracking of the individual vertebrae, the display84 may display the image 108 ii that is updated in substantially realtime to view the position of the vertebrae 166 i, 166 ii as arepresentations 166 i′ and 166 ii′. The representations of the vertebraeon the display may include the segmented images, as discussed above thatare updated with the tracking devices associated therewith.

Further, as illustrated in FIG. 11A, the intervertebral body 600 may bepositioned relative to selected portions of the anatomy, such as thesecond vertebrae 166 i. The intervertebral implant 600 may include thetracking device 604. The implant 600, therefore, once implanted, may bedetermined to be positioned adjacent to the endplate vertebrae 166 ii.Accordingly, the display, such as the display 11B and/or 12B, may beupdated to illustrate the vertebrae image 166 ii as being in contactwith the intervertebral body 600. As illustrated in FIG. 11B, thegraphical representation of the implant 600′ may be displayed in contactwith the vertebral representation 166 ii′ and the image 108 may beupdated to illustrate the same even if the second vertebrae 166 ii isnot directly tracked. Due to the positioning of the implant 600 incontact with the vertebrae 166 ii, the image 108 may be updated toillustrate the position of the vertebrae relative to the implant, suchas in contact with the implant 600 by illustrating the vertebral display166 ii′ in the image in contact with the graphical representation of theimplant 600. Similarly, the second image 108 ii in FIG. 12B may beupdated due to positioning of an implant between the vertebrae 166 i andthe second vertebrae 166 ii. Thus, the updated image may illustratedselected portions (e.g. graphical representations of instruments and/orportions of the image) in different or changes positions relative to afirst image.

In various embodiments, the implant 600 may be an adjustable orexpandable implant. It is understood that any appropriate implant may bean adjustable implant and the intervertebral body 600 is merelyexemplary. Nevertheless, the intervertebral body 600 may be positionedbetween two vertebrae that may be directly tracked such as the firstvertebrae 166 i and the second vertebrae 166 ii. Although notspecifically illustrated in FIG. 11A, as discussed above all of thevertebrae of interest may be directly tracked with the tracking deviceas illustrated in FIG. 2. Thus, the intervertebral body 600 may beadjusted, such as adjusted to a maximum distance or dimension.

The tracked position of the first vertebra 166 i to the second vertebra166 ii may be used to determine the efficacy of the implant 600 bymeasuring the amount of movement between the two vertebrae. For example,as illustrated in FIG. 12A the intervertebral body may be positionedbetween the two vertebrae 166 i and 166 ii. The angle or distancebetween the two lines 610, 612 representing the respective implants 616,618 may be measured. The intervertebral body may then be adjusted andthe distance between the two lines 610, 612 may then be measured and theimage may be updated in the image 108 ii. The user 72 may evaluateand/or the navigation system 20 may evaluate the difference in positionand/or ultimate position between the two vertebrae 166 i and 166 ii inthe image 108 ii to determine the efficacy of the implant. For example,if the movement is not parallel, a selected angle has not been achieved,or other appropriate change has not been achieved due to the change ofthe implant 600 the user may evaluate the efficacy of the implant and/orselect a new implant during a trial.

Accordingly, tracking the plurality of elements in the navigation field,such as in the subject 30, may be used for performing the procedure orany appropriate procedure relative to the subject 30. The tracking ofthe plurality of elements may be used to update the display 108 toconfirm the efficacy of a selected portion of a procedure, positionimplant, or other appropriate information. Thus, tracking the pluralityof portions in the navigation space may be used to confirm a procedureand/or assist in planning additional portions of a procedure, includinga trail stage when selecting an appropriate or selected implant.

Further, by tracking all or a plurality of the members in the navigationspace. The image 108 may be updated with substantially real timeposition of all of the elements in the region of interest (e.g.vertebrae) for a procedure. Thus, a more accurate position of anunconnected member, such as the instrument 68, may be navigated relativeto members in the region of interest, such as the vertebrae. The display84 displaying the image 108 may include substantially real time andprecise positioning of the elements therein (e.g. segmented members,instruments, etc.) for performing a selected procedure. Moreover, theimage 108 may be a direct image or generated image (such as based onx-ray image data). The portions of the image may be segmented therefrom,such as the individual vertebra. The image 108 may be updated by movingthe segmented portions. The image 108 may also be updated by displayand/or moving graphical representations of the imaged portions or othermembers (e.g. instruments).

The foregoing description of the embodiments has been provided forpurposes of illustration and description. It is not intended to beexhaustive or to limit the invention. Individual elements or features ofa particular embodiment are generally not limited to that particularembodiment, but, where applicable, are interchangeable and can be usedin a selected embodiment, even if not specifically shown or described.The same may also be varied in many ways. Such variations are not to beregarded as a departure from the invention, and all such modificationsare intended to be included within the scope of the invention.

It should be understood that various aspects disclosed herein may becombined in different combinations than the combinations specificallypresented in the description and accompanying drawings. It should alsobe understood that, depending on the example, certain acts or events ofany of the processes or methods described herein may be performed in adifferent sequence, may be added, merged, or left out altogether (e.g.,all described acts or events may not be necessary to carry out thetechniques). In addition, while certain aspects of this disclosure aredescribed as being performed by a single module or unit for purposes ofclarity, it should be understood that the techniques of this disclosuremay be performed by a combination of units or modules associated with,for example, a medical device.

In one or more examples, the described techniques may be implemented inhardware, software, firmware, or any combination thereof. If implementedin software, the functions may be stored as one or more instructions orcode on a computer-readable medium and executed by a hardware-basedprocessing unit. Computer-readable media may include non-transitorycomputer-readable media, which corresponds to a tangible medium such asdata storage media (e.g., RAM, ROM, EEPROM, flash memory, or any othermedium that can be used to store desired program code in the form ofinstructions or data structures and that can be accessed by a computer).

Instructions (also referred as a computer program), which may resultfrom or be derived from an algorithm as discussed above, may be executedby one or more processors, such as one or more digital signal processors(DSPs), general purpose microprocessors, application specific integratedcircuits (ASICs), field programmable logic arrays (FPGAs), or otherequivalent integrated or discrete logic circuitry. Accordingly, the term“processor” as used herein may refer to any of the foregoing structureor any other physical structure suitable for implementation of thedescribed techniques. Also, the techniques could be fully implemented inone or more circuits or logic elements.

What is claimed is:
 1. A method of performing a navigated procedurerelative to a subject, comprising: accessing a first image data of atleast a region of interest of the subject; tracking a reference point atleast by (i) tracking first tracking device in a first coordinate systemand (ii) tracking a second tracking device in a second coordinatesystem; determining a common reference in the first coordinate systemand the second coordinate system by tracking the first tracking andtracking the second tracking device; tracking a third tracking device inthe second coordinate system; tracking a fourth tracking device in thesecond coordinate system; associating the third tracking device with afirst segmented portion in the first image data; associating the fourthtracking device with a second segmented portion in the first image data;displaying the first image with a display device; registering a firstimage data coordinate system of the first image data to a navigationspace based on the tracked reference point; and updating the firstimage, including changing a position of the first segmented portion orthe second segmented portion based upon tracking the third trackingdevice and tracking the fourth tracking device.
 2. The method of claim1, further comprising: segmenting the image data to determine at least aboundary of the selected members.
 3. The method of claim 1, furthercomprising: tracking a fifth tracking device in the first coordinatesystem, wherein the fifth tracking device is associated with aninstrument; and displaying a graphical representation of the instrumentrelative to the displayed first image.
 4. The method of claim 1, furthercomprising: fixing the first tracking device and the second trackingdevice to a single mounting structure.
 5. The method of claim 4, whereintracking the first tracking device in the first coordinate systemincludes tracking an optical tracking member with an optical localizer;wherein tracking the second tracking device in the second coordinatesystem includes tracking an electro-magnetic coil with anelectro-magnetic localizer.
 6. The method of claim 5, wherein the thirdtracking device is connected to a first member of the subject and thefourth tracking device is connected to a second member.
 7. The method ofclaim 6, further comprising: determining a change in position from afirst time to a second time of the third tracking device; wherein thefirst segmented member is the first member and updating the first imageincludes illustrating a real time position of the first member due tothe determined change in position of the third tracking device.
 8. Themethod of claim 1, further comprising: fixing the third tracking deviceto a first member of the subject; fixing the fourth tracking device to asecond member of the subject; wherein associating the third trackingdevice with the first segmented portion in the first image data includesproviding a first input to a navigation system by a user; associatingthe fourth tracking device with a second segmented portion in the firstimage data includes providing a second input to the navigation system bythe user; wherein the first input and the second input allow for theupdated first image to be displayed.
 9. A system to navigate a procedurerelative to a subject, comprising: a display device to display a firstimage having a first segmented portion and a second segmented portion; afirst tracking system defining a first tracking space with a firstcoordinate system; a second tracking system defining a second trackingspace with a second coordinate system; a reference point tracking systemhaving (i) a first tracking device trackable in the first coordinatesystem and (ii) a second tracking device trackable in the secondcoordinate system; a third tracking device trackable in the secondcoordinate system, wherein the third tracking device is associated withthe first segmented portion in the first image data; a fourth trackingdevice trackable in the second coordinate system, wherein the fourthtracking device is associated with the second segmented portion in thefirst image data; and a navigation processor system operable to:register a first image data coordinate system of the first image data toa navigation space based on the reference point tracking system; andupdating the first image, including changing a position of the firstsegmented portion or the second segmented portion, based upon trackingthe third tracking device and tracking the fourth tracking device, andgenerate the updated first image for display with the display device.10. The system of claim 9, wherein the navigation processor system isfurther operable to access the first image data of at least a region ofinterest of the subject.
 11. The system of claim 9, wherein the firsttracking system operates in a first modality and the second trackingsystem operations in a second modality different than the firstmodality.
 12. The system of claim 11, further comprising: an instrumenttracked with the first tracking system; wherein the generated updatedfirst image includes a representation of the instrument relative to thefirst segmented portion.
 13. The system of claim 12, wherein thenavigation processor system is further operable to correlated the firstcoordinate system and the second coordinate system due at least to thereference point tracking system; wherein the updated image is based on acorrelation of the first coordinated system and the second coordinatedsystem.
 14. A method of performing a navigated procedure relative to asubject, comprising: accessing a first image data of at least a regionof interest of the subject; tracking a first reference point by trackinga first tracker assembly having at least (i) tracking first trackingdevice in a first coordinate system and (ii) tracking a second trackingdevice in a second coordinate system; determining a common reference inthe first coordinate system and the second coordinate system by trackingthe first tracking and tracking the second tracking device; tracking athird tracking device in only one of the first coordinate system or thesecond coordinate system; associating the first tracker assembly with afirst segmented portion in the first image data; associating the thirdtracking device with a second segmented portion in the first image data;displaying the first image with a display device; registering a firstimage data coordinate system of the first image data to a navigationspace based on the tracked reference point; and updating the firstimage, including changing a position of the first segmented portion orthe second segmented portion based upon tracking the third trackingdevice and tracking the fourth tracking device.
 15. The method of claim14, further comprising: tracking a fourth tracking device in the secondcoordinate system; associating the fourth tracking device with a thirdsegmented portion in the first image data; and updating the first image,including changing a position of the third segmented portion based upontracking the fourth tracking device.